Can you tell if tongue movements are real or synthesized?
نویسندگان
چکیده
We have investigated if subjects are aware of what natural tongue movements look like, by showing them animations based on either measurements or rule-based synthesis. The issue is of interest since a previous audiovisual speech perception study recently showed that the word recognition rate in sentences with degraded audio was significantly better with real tongue movements than with synthesized. The subjects in the current study could as a group not tell which movements were real, with a classification score at chance level. About half of the subjects were significantly better at discriminating between the two types of animations, but their classification score was as often well below chance as above. The correlation between classification score and word recognition rate for subjects who also participated in the perception study was very weak, suggesting that the higher recognition score for real tongue movements may be due to subconscious, rather than conscious, processes. This finding could potentially be interpreted as an indication that audiovisual speech perception is based on articulatory gestures.
منابع مشابه
Real vs. rule-generated tongue movements as an audio-visual speech perception support
We have conducted two studies in which animations created from real tongue movements and rule-based synthesis are compared. We first studied if the two types of animations were different in terms of how much support they give in a perception task. Subjects achieved a significantly higher word recognition rate in sentences when animations were shown compared to the audio only condition, and a si...
متن کاملAre real tongue movements easier to speech read than synthesized?
Speech perception studies with augmented reality displays in talking heads have shown that tongue reading abilities are weak initially, but that subjects become able to extract some information from intra-oral visualizations after a short training session. In this study, we investigate how the nature of the tongue movements influences the results, by comparing synthetic rulebased and actual, me...
متن کاملCan you 'read' tongue movements? Evaluation of the contribution of tongue display to speech understanding
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau...
متن کاملحاملگی
If all pregnant women worry about their fetus, worries of pregnant nurses are more serious and actual. Which groups of women have more chance about hydatidform mole, amniotic fluid embolism or Sheehan’s syndrome? Fortunately, these complicated problems are very rare but what about daily injuries due to infectious diseases, radioactive substances, anticancer drugs and other chemical substances? ...
متن کاملدروغگویی به بیمار با انگیزهی خیرخواهانه
Telling the truth to patients is a key issue in medical ethics. Today, most physicians hold that truth-telling to patients is crucial, and that lying to patients or withholding information from them is not acceptable. It seems, however, that absolute and unconditional truth-telling is not always possible, and it may not be feasible to tell some patients certain truths under some circumstances. ...
متن کامل